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Description 

VISION-BASED METHOD AND SYSTEM 

FOR AUTOMOTIVE PARKING AID, 
REVERSING AID, AND PRE-COLLISION 
SENSING APPLICATIONS 

Cross Reference to Related Applications 

[0001] The present invention is related to U.S. Patent Application 
Number 10/064,550, filed July 25, 2002, entitled "Poten- 
tial Collision Detection and Parking Aid System", U.S. 
Patent Application Number 10/064,552, filed July 25, 
2002, entitled "Potential Collision Detection and Reversing 
Aid System", and U.S. Patent Application Number 
10/249,549, filed April 17, 2003, entitled "Leaky Cable 
Based Method and System for Automotive Parking Aid, 
Reversing Aid, and Pre-Collision Sensing", which are in- 
corporated by reference herein. 
Background of Invention 



[0002] The present invention relates to several different sensing 



systems for an automotive vehicle, such as parking-aid, 
reversing -aid, and pre-collision sensing systems, and 
more particularly to a system and method of performing 
object detection for the stated systems utilizing vision 
technology. 

[0003] Various sensing systems currently exist for detection, 

classification, tracking, and relative distance and velocity 
estimation of objects within a close proximity of a host 
automotive vehicle. The sensing systems may be ultra- 
sonic, radar, or vision-based. The ultrasonic-based sys- 
tems are used primarily for parking-aid and reversing-aid 
applications whereas the vision-based systems are used 
primarily for parking-aid, lane departure, lane-keeping 
and adaptive cruise control applications. The radar-based 
systems may be used in parking-aid, reversing-aid, adap- 
tive cruise control and pre-crash sensing applications. 

[0004] Parking-aid and reversing-aid systems are typically used 
in the automotive industry and are becoming abundantly 
available in the market. Parking-aid systems and revers- 
ing-aid systems indicate to a vehicle operator that an ob- 
ject, that may not be visible to the vehicle operator, is 
within a stated distance of the vehicle. The vehicle opera- 
tor may then respond accordingly. 



[0005] Parking-aid systems are typically used to detect an object 
forward and rearward of a host vehicle. When the host ve- 
hicle is traveling in a forward direction at relatively slow 
velocities of approximately less than 10 kmph, the park- 
ing-aid system detects objects approximately within lm 
forward of the host vehicle. When the vehicle is in a re- 
verse gear, such that the vehicle is traveling in a rearward 
direction the parking-aid system typically detects objects 
ranging from within approximately 2m of the host vehicle. 

[0006] Reversing-aid systems detect objects only in the back of 
the vehicle. Reversing-aid systems are typically used to 
detect an object rearward of and within approximately 2m 
of the host vehicle to within approximately 5m of the host 
vehicle, when the host vehicle is in a reverse gear. Thus, 
when the vehicle is in the reverse gear, a rearward sensing 
system operating in a reversing-aid mode covers the re- 
quirements for both reversing-aid and rearward parking- 
aid systems. 

[0007] Pre-collision systems typically detect objects in the front 
or rear of the vehicle when traveling in the forward direc- 
tion at speeds approximately above lOkmph, but at rela- 
tively larger distances than that of parking-aid systems 
and reversing-aid systems. It is preferred in pre-collision 



systems to accurately detect relative velocities of objects 
with relatively higher accuracy for relatively larger dis- 
tances and utilize a relatively quicker update rate. 

[0008] Adaptive cruise control systems adjust a host vehicle trav- 
eling speed to maintain a safe operating distance between 
the host vehicle and a target vehicle. Lane departure and 
lane-keeping systems monitor lane markers or roadway 
lane designating lines, which sometimes are referred to as 
lane striping or lane separating lines, and generates a 
warning signal to warn a vehicle operator when a host ve- 
hicle is departing from or is not maintaining travel within 
a current operating lane. 

[0009] The parking-aid, reversing-aid, and pre-collision systems 
commonly use multiple radar or ultrasonic sensors, which 
can be costly. 

[0010] Although, the adaptive cruise control, lane departure, and 
lane-keeping systems tend to utilize fewer sensors than 
parking-aid, reversing-aid, and pre-collision systems, 
they also tend to be costly due to use of radar or vision 
sensors and use of vision processors. 

[0011] it is desirable, when designing a vehicle to minimize vehi- 
cle components, system complexity, and vehicle produc- 
tion and manufacturing costs. It is therefore also desirable 



to provide an object detection system that may be applied 
as a parking-aid, reversing-aid, pre-collision, adaptive 
cruise control, lane departure, and lane-keeping system 
and at the same time minimizes the amount of object de- 
tection sensors and costs involved therein. 
Summary of Invention 

[0012] The present invention provides a system and method of 
performing object detection within an automotive vehicle 
utilizing vision-based technologies. A vision-based object 
detection system for a vehicle is provided. The vision- 
based system includes multiple vision sensing systems 
that have a vision receiver and generates an object detec- 
tion signal. A controller includes a plurality of sensing 
system aid modules that correspond to each of the vision 
sensing systems. The controller operates the sensing sys- 
tem aid modules in response to a vehicle parameter and 
generates a safety system signal in response to the object 
detection signal. The sensing system aid modules have 
associated operating modes and operate the vision sens- 
ing systems in the operating modes in response to the ve- 
hicle parameter. 

[0013] one of several advantages of the present invention is that 
it provides a single vision-based object detection system 



that is capable of operating in multiple sensing system 
modes and performing multiple collision avoidance, coun- 
termeasure, and comfort and convenience type tasks. 
[0014] Another advantage of the present invention is that it uti- 
lizes a single controller microprocessor for operational 
control of multiple sensing systems. The controller is ca- 
pable of operating in multiple sensing system modes, 
thus minimizing number of components, costs, and 
weight. 

[0015] The present invention itself, together with attendant ad- 
vantages, will be best understood by reference to the fol- 
lowing detailed description, taken in conjunction with the 

accompanying figures. 
Brief Description of Drawings 

[0016] For a more complete understanding of this invention ref- 
erence should now be made to embodiments illustrated in 
greater detail in the accompanying figures and described 
below by way of examples of the invention wherein: 

[0017] Figure 1 is a block diagrammatic view of a vision-based 
object detection system for a vehicle in accordance with 
an embodiment of the present invention; 

[0018] Figure 2 is a top perspective view and an illustrative de- 
tection area diagram for a vision-based object detection 



system having a rearward directed vision receiver in ac- 
cordance with another embodiment of the present inven- 
tion; 

[0019] Figure 3 is a top perspective view and an illustrative de- 
tection area diagram for a vision-based object detection 
system having a forward directed vision receiver and a 
rearward directed vision receiver in accordance with an- 
other embodiment of the present invention; 

[0020] Figure 4 is a top perspective view and an illustrative de- 
tection area diagram for a vision-based object detection 
system having a pair of side directed vision receivers and 
a rear directed vision receiver in accordance with another 
embodiment of the present invention; 

[0021] Figure 5 is a logic flow diagram illustrating a method of 
performing object detection decision-making within a ve- 
hicle utilizing a vision-based object detection system in 
accordance with multiple embodiments of the present in- 
vention; and 

[0022] Figure 6 is a logic flow diagram illustrating another 

method of performing object detection decision-making 
within a vehicle utilizing a vision-based object detection 
system in accordance with multiple embodiments of the 
present invention. 



Detailed Description 

[0023] | n the following figures the same reference numerals will 
be used to refer to the same components. While the 
present invention is described with respect to a vision- 
based system and method of performing object detection 
near a vehicle, the present invention may be adapted and 
applied to various systems including: collision warning 
systems, collision avoidance systems, parking-aid sys- 
tems, reversing-aid systems, passive countermeasure 
systems, adaptive cruise control systems, lane departure 
systems, lane-keeping systems, or other systems known 
in the art. 

[0024] | n the following description, various operating parameters 
and components are described for multiple constructed 
embodiments. These specific parameters and components 
are included as examples and are not meant to be limit- 
ing. 

[0025] Also, in the following description, the term "slow vehicle 
traveling velocity" refers to a vehicle traveling at velocities 
less than or equal to approximately lOkmph. 

[0026] Additionally, in the following description, the term "per- 
forming" may include activating, deploying, initiating, 
powering, and other terms known in the art that may de- 



scribe the manner in which a countermeasure or a comfort 
and convenience feature may be operated. 
[0027] As well, in the following description, various countermea- 
sures are discussed. The countermeasures may be re- 
versible or irreversible. Reversible countermeasures refer 
to countermeasures that may be reset to their original 
form or used repeatedly without a significant amount of 
functional deficiency, which may be determined by a sys- 
tem designer. Irreversible countermeasures refer to coun- 
termeasures such as airbags that, once deployed, are not 
reusable. 

[0028] Furthermore, a countermeasure signal may include infor- 
mation pertaining to the above-stated reversible and irre- 
versible countermeasures or may include other informa- 
tion, such as collision warning information, and parking- 
aid or reversing-aid countermeasure information. For ex- 
ample, the countermeasure signal may contain object de- 
tection information, which may be used to indicate to a 
vehicle operator the presence or close proximity of a de- 
tected object. 

[0029] Moreover, the term "vision receiver" may refer to a vision 
sensor lens, a vision sensor, a camera lens, a camera, or 
other vision receiver known in the art. A vision receiver 



may be stationary or may rotate or move in various direc- 
tions. For example, in one embodiment of the present in- 
vention, vision receivers are in the form of high dynamic 
range wide-angle cameras. 

[0030] | n addition, the term "object" may refer to any animate or 
inanimate object. An object may be a vehicle, a pedes- 
trian, a lane marker, a road sign, a roadway lane designat- 
ing line, or other object known in the art. 

[0031] Referring now to Figure 1, a block diagrammatic view of a 
vision-based object detection system 10 for a vehicle 12 
in accordance with an embodiment of the present inven- 
tion is shown. The system 10 includes multiple vision 
sensing systems 14 and a controller 16. Each of the vision 
sensing systems 14 has one or more sensing system aid 
modules 18, that are located within the controller 16, and 
respective vision receivers 20. The sensing systems 14 in- 
clude a frontal and rear collision vision sensing system 
22, a rearward collision vision sensing system 24, and a 
side collision vision sensing system 26. The sensing sys- 
tems 14 detect and monitor objects that are in close 
proximity to the vehicle 12. The controller 16 receives 
current vehicle status information from a transmission 
gear sensor 28 and a velocity sensor 30 and in response 



to detected objects generates countermeasure signals for 
countermeasure indication, via an indicator 32, or activa- 
tion of appropriate countermeasures, which is represented 
by box 34. 

[0032] The sensing systems 14 have multiple modes for per- 
forming multiple collision avoidance, countermeasure, 
and comfort and convenience type tasks of operation. The 
modes include a reversing-aid mode, a parking-aid mode, 
a pre-collision mode, an adaptive cruise control mode, a 
lane departure mode, a lane-keeping mode, or other 
sensing system modes known in the art. 

[0033] The parking-aid mode consists of a forward detection 
mode and a rearward detection mode. The rearward de- 
tection mode is similar to the reversing-aid mode. The 
forward detection mode refers to monitoring a forward 
sensing zone having a sensing distance of approximately 
up to 1 meter and a lateral sensing distance that is ap- 
proximately equal to 0.5m. The reward detection mode 
refers to monitoring a rearward-sensing zone having a 
sensing distance of approximately up to 2.0m to 5.0m 
and a lateral sensing distance of approximately equal to 
0.5m. For an illustration of the forward sensing zone, the 
rearward sensing zone, and the lateral sensing zones, as 



described above and for a further detailed explanation on 
the parking-aid mode and the reversing-aid mode see the 
patent applications incorporated herein by reference. 
[0034] The pre-collision mode may consist of a forward detection 
zone, a rearward detection zone, or a side detection zone, 
as is best seen in Figure 2-4. The pre-collision detection 
zones in general are larger in area and cover larger dis- 
tances away from the vehicle 12 as compared to the de- 
tection zones of the parking-aid mode and of the revers- 
ing-aid mode. 

[0035] The adaptive cruise control mode is used for monitoring 
objects forward of the vehicle 12 and for maintaining a 
safe predetermined distance away from the detected ob- 
jects to prevent collision therewith. When operating in the 
adaptive cruise control mode the controller 16 may warn a 
vehicle operator of an impending object or perform a 
countermeasure as to alter speed of travel of the vehicle 
12. 

[0036] The lane departure mode and the lane-keeping mode re- 
fer to modes by which the controller 16 monitors lane 
markings or roadway lane designating lines and warns a 
vehicle operator when the vehicle 12 is exiting a current 
lane of travel, directed to exit a current lane of travel, and 



performs a countermeasure 34 and/or maintains a current 
lane of travel, such as by supplementing the steering con- 
trol of the vehicle 12. 

[0037] Performance of the sensing systems 14 depends upon a 
selected mode of operation and corresponding counter- 
measures 34 to be performed. For example, in the park- 
ing-aid mode and in the reversing-aid mode it may be 
desirable to detect positioning of objects with relatively 
higher accuracy as compared to when in the pre-collision 
mode. In the pre-collision mode it may be desirable to ac- 
curately detect relative velocities of objects with relatively 
higher accuracy for relatively larger distances and utilize a 
relatively quicker update rate. Update rate refers to time 
between object detection signals, or sometimes it is re- 
ferred to as a refresh rate. There can exist a tradeoff be- 
tween accurately measuring object positioning versus ac- 
curately measuring velocity of objects relative to the vehi- 
cle 12 and update rate. 

[0038] The frontal and rear vision system 22 includes a pre- 
collision sensing module 36, a parking-aid module 40, an 
adaptive cruise control module 42, a lane departure aid 
module 44, and a lane-keeping aid module 46. The 
frontal and rear vision system 22 detects and monitors 



objects in close proximity of a forward portion 48 and a 
rearward portion 49 of the vehicle 12 through use of one 
or more of the vision receivers 20. The vision receivers 20, 
as used by the frontal part of the frontal and rear vision 
system 22, may be located in or near and coupled to a 
bumper or a grill (both of which are not shown) of the ve- 
hicle 12, may be mounted to a backside of a rear view 
mirror 52, or may be located elsewhere in the vehicle 12. 
For example, when the frontal and rear vision system 22 
is in the parking-aid mode the system 22 may utilize a vi- 
sion sensor 54 that is located relatively closer to the front 
of the vehicle 12, such that view area directly in front of 
the vehicle 12 is unobstructed by vehicle structure or 
components. When the frontal vision system 22 is in a 
pre-collision mode and is monitoring a larger area for- 
ward of the vehicle 12 the frontal and rear vision system 
22 may utilize a vision receiver 56 located on the rearview 
mirror 52. 

[0039] The rearward only vision system 24 includes the pre- 
collision sensing module 36 and a reversing-aid module 
58. The rear vision part of the frontal and rear vision sys- 
tem 22, and the vision part of the rearward system 24 
may also utilize one or more of the vision receivers 20, 



such as vision sensors 60, which may be located in or 
near a rear bumper (not shown) of the vehicle 12 or may 
be mounted near a rear roof edge (also not shown) and be 
directed rearward. A near bumper mounted vision sensor 
62 may be used when in a reversing-aid mode or a 
parkingaid mode. A near roof edge vision sensor 64 may 
be utilized when in a pre-collision mode. The rearward vi- 
sion system 24 may for example when operating in a re- 
versing-aid mode indicate to a vehicle operator, via the 
indicator 32, an audible sound or a video signal that the 
vehicle 12 is moving in a direction as to potentially collide 
with an impending object. 

[0040] The side vision system 26 includes the pre-collision sens- 
ing module 36. The side vision system 26 may also have 
any number of the vision receivers 20. In the embodi- 
ments of Figures 1 and 4 a single vision receiver 65 is 
used on each side of the vehicle 12. 

[0041] The controller 16 includes collision avoidance and coun- 
termeasure modules 66 and comfort and convenience 
modules 68. The collision avoidance and countermeasure 
modules 66 include the pre-collision sensing module 36, 
the adaptive cruise control module 42, the lane departure 
aid module 44, and the lane-keeping aid module 46. The 



comfort and convenience modules 68 include the revers- 
ing-aid module 58 and the parking-aid module 40. Of 
course, the controller 16 may include other sensing sys- 
tem aid modules known in the art. The modules 66 and 
68 include corresponding algorithms for performing the 
above-stated modes of operation and may be software 
based. 

[0042] The controller 16 may operate the system 10 in any or all 
of the above stated modes simultaneously. The controller 
16 to obtain an appropriate operating performance for a 
selected operating mode, may adjust accuracy measure- 
ments corresponding with object relative position and ve- 
locity, as well as adjusting update rate and field of view 
(FOV). In adjusting FOV the controller 16 may transition 
between different lenses, transition between different 
cameras, may generate a split screen, or perform some 
other FOV adjusting technique known in the art. A split 
screen (not shown), for example, may be utilized to moni- 
tor both directly in front of the vehicle 12 and areas far- 
ther from the vehicle 12. A first half of the screen may 
have a first FOV and a second half of the screen may have 
a second FOV. The controller 16 may operate one vision 
receiver in a parking-aid mode having a first resolution 



and simultaneously operate a second vision receiver in a 
pre-collision mode with a second resolution that is differ- 
ent from that of the first resolution, in order to compen- 
sate or adjust for different desired FOVs. 

[0043] The controller 16 may be microprocessor based such as a 
computer having a central processing unit, memory (RAM 
and/or ROM), and associated input and output buses. The 
controller 16 may be an application-specific integrated 
circuit or other logic devices known in the art. The con- 
troller 16 may be a portion of a central vehicle main con- 
trol unit, an interactive vehicle dynamics module, a re- 
straints control module, a main safety controller, or may 
be a stand-alone controller as shown. 

[0044] The controller 16 determines which of the sensing system 
modes to operate in and operates the appropriate corre- 
sponding vision receivers 20 in response thereto. The 
controller 16 while operating in one or more of the sens- 
ing system modes may determine to perform one or more 
of the countermeasures 34 and indicate to a vehicle oper- 
ator various object and vehicle status information. De- 
pending upon the vehicle and object relative positions, 
velocities, and accelerations, the controller 16 may deter- 
mine whether to indicate to a vehicle operator of a poten- 



tial collision or may perform a countermeasure, as 
needed, so as to prevent a collision, mitigate a potential 
injury, or prevent the vehicle 12 from traveling outside a 
current lane of travel. 

[0045] The controller 16 may also determine whether system de- 
vices are malfunctioning and indicates to a vehicle opera- 
tor corresponding information in that respect. When a 
system device is malfunctioning the controller 16 may 
disable that system device, as well as other vehicle devices 
to prevent a device from performing inappropriately. 

[0046] The gear sensor 28 may also be of various forms. The 

gear sensor 28 may be in the form of a switch, a solenoid, 
a motion sensor, an encoder, or in another form known in 
the art. The gear sensor 28 determines the operating gear 
of the vehicle 12 and generates a gear signal. Note the 
gear sensor 28 may detect an operating gear of a conven- 
tional mechanical transmission or may correspond to an 
operating range of an electronic transmission. 

[0047] The velocity sensor 30 may be of various forms, such as a 
transmission rotation sensor, awheel speed sensor, an 
optical sensor, or other velocity sensor known in the art. 
The velocity sensor 30 determines the traveling speed of 
the vehicle 12 and generates a velocity signal. 



[0048] indicator 32 is used to signal or indicate a safety system 
signal, which may include a warning signal, a collision- 
warning signal, a countermeasure signal, or an object 
identification signal in response to the object detection 
signals. The indicator 32 may include a video system, an 
audio system, an LED, a light, global positioning system, a 
heads-up display, a headlight, a taillight, a display sys- 
tem, a telematic system or other indicator. The indicator 
32 may supply warning signals, collision-related informa- 
tion, lane departure and lane-keeping information, exter- 
nal-warning signals to objects or pedestrians located out- 
side of the vehicle 12, or other pre and post collision in- 
formation. 

[0049] The countermeasures 34 may include passive counter- 
measures such as pre-arming airbags, activating a re- 
versible seatbelt pre-tensioner, or activating a headrest 
mechanism. Countermeasures 34 may also include brake 
control, throttle control, steering control, suspension con- 
trol, transmission control, chassis control, and other pas- 
sive or active countermeasures known in the art. The 
countermeasures 34 may include, for example, steering a 
vehicle to prevent departure from a current lane of travel 
or may include indicating to a vehicle operator that the 



vehicle 12 is exiting or is directed as to exit the current 
lane of travel. 

[0050] The vision-based system 10 may be in various configura- 
tions and utilize any number of the sensing systems 14 
and in any combination thereof. Of course, for simplicity 
and cost reduction, the present invention may be modified 
and simplified so as to have a reduced number of compo- 
nents and operate in a reduced number of modes. In re- 
ducing the number of modes of operation, controller 16 
processing ability requirements are also reduced, which in 
general further decreases costs of the system 10. The 
processing ability of a controller 16 may reflect the num- 
ber of and the different types of sensing system modes 
that are used for a given application. The less sensing 
system modes that are to be performed by the controller 
16, the lower the degree of processing capability required 
of the controller 16. For example, when performing multi- 
ple sensing system modes that utilize multiple vision re- 
ceivers, processing speed of the controller 16 is at least at 
a speed that adequately maintains appropriate update rate 
for each vision receiver. Maintaining appropriate update 
rate also maintains sufficient accuracy for each of the 
modes utilized therein. A combination of front and rear 



vision system 22, and the side vision system 26 of Figure 
1 provides a comprehensive 360 degree vehicle coverage; 
Figures 2-4 illustrate other relatively simplified embodi- 
ments of the present invention. 

[0051] Referring now to Figures 2-4, top perspective views and 
illustrative detection area diagrams for vision-based ob- 
ject detection systems, are shown, in accordance with 
multiple embodiments of the present invention. 

[0052] The embodiment of Figure 2, is directed towards a vision- 
based object detection system 10' that is simplified from 
that of Figure 1 as to operate in either a reversing-aid 
mode or in a rearward pre-collision sensing mode. A sin- 
gle vision receiver 70 is mounted in a rear portion 72 of a 
host vehicle 12' and is directed rearward to monitor de- 
tection area 73 for an object, such as target 74. A con- 
troller 16' is coupled to the vision receiver 70 and to the 
transmission gear sensor 28. The rearward pre-collision 
sensing mode is similar to that of the pre-collision sens- 
ing mode except that the controller 16' monitors for ob- 
jects rearward of the vehicle 12' and not forward of the 
vehicle 12'. 

[0053] The embodiment of Figure 3, is directed towards a vision- 
based object detection system 10" that is simplified from 



that of Figure 1 as to operate in a parking-aid mode, a 
pre-collision mode, an adaptive cruise control mode, a 
lane departure mode and in a lane-keeping mode. A first 
vision receiver 75 is mounted in a forward portion 76 of 
the vehicle 12" and a second vision receiver 78 is 
mounted in a rearward portion 79 of the vehicle 12" to 
monitor a forward detection area 80 and a rearward de- 
tection area 81, respectively. A forward target 82 is 
shown. A controller 16" is coupled to both vision receivers 
75 and 78 and the transmission gear sensor 28 and de- 
tects and monitors objects forward and rearward of the 
vehicle 12". 

[0054] The embodiment of Figure 4 is similar to that of Figure 2, 
except that it further includes a pair of side vision re- 
ceivers 82 that are coupled to a controller 16'". Vision- 
based detection system 10'" of Figure 4 when operating in 
a pre-collision mode utilizes the pair of vision receivers 
82 to also monitor objects laterally or to the side of the 
vehicle 12 m , such as a target vehicle 84 approaching the 
vehicle 12 m , as represented by boxes 86 and arrow 88. 
Side detection areas 90 are shown in addition to the rear 
detection area 73. 

[0055] Although, not shown the embodiments of Figures 2-4 



may also include a velocity sensor, an indicator, and 
countermeasures, such as the velocity sensor 30, the indi- 
cator 32, and the countermeasures 34. 

[0056] Referring now to Figure 5, a logic flow diagram illustrating 
a method of performing object detection decision-mak- 
ing, for indicator and countermeasure activation within 
the vehicle 12 utilizing the system 10 in accordance with 
embodiments of the present invention is shown. Although 
the following steps are described in respect to the em- 
bodiment of Figure 1, the steps may be utilized and mod- 
ified for other embodiments of the present invention. 

[0057] | n s tep 200, the side vision system 26 is operated in the 
pre-collision mode. In step 201, the gear sensor 28 gen- 
erates a transmission gear signal representing a current 
operating gear. The vehicle 12 may be operating in a for- 
ward gear, a rearward gear, or a stationary gear. In step 
202, the controller 16 determines whether the vehicle 12 
is in a reverse gear in response to the gear signal. 

[0058] | n s tep 204, when a reverse gear is engaged, the con- 
troller 16 operates the forward part of the vision system 
22 in the pre-collision sensing mode and the rearward 
part of the vision system 22, which is functionally similar 
to the vision system 24 in the reversing-aid mode. In step 



206, when a reverse gear is not engaged, the controller 
16 receives the vehicle velocity signal generated by the 
velocity sensor 30. 

[0059] | n s tep 208, the controller 16 determines when velocity of 
the vehicle 12 is less than lOkmph. In step 210, when ve- 
locity of the vehicle 12 is less than lOkmph, the controller 
16 operates the forward vision system in the parking-aid 
mode. In step 2 12, when velocity of the vehicle 12 is 
greater than lOkmph, the controller 16 may operate the 
forward vision system 22 in the pre-collision sensing 
mode, in the adaptive cruise control mode, in the lane de- 
parture mode, in the lane-keeping mode, or in any com- 
bination thereof. 

[0060] | n s tep 2 14, whether velocity of the vehicle 12 is less 

than, equal to, or greater than lOkmph the controller 16 
operates the rearward vision system 24 in a pre-collision 
sensing mode. In one embodiment of the present inven- 
tion steps 210 or 212 and step 214 are performed simul- 
taneously. 

[0061] in step 216, the controller 16 assesses whether to gener- 
ate warning signals or countermeasure signals or both the 
warning and countermeasure signals in response to de- 
tection of objects. The warning signals and countermea- 



sure signals may be indicated to a vehicle operator via the 
indicator 32. When the controller 16 determines that no 
warning signals or countermeasure signals are to be gen- 
erated the controller 16 returns operation to step 200. 
When warning signals or countermeasure signals are gen- 
erated, the controller 16 proceeds to step 218. 
[0062] | n step 218, the controller 16 may generate warning sig- 
nals or countermeasure signals in response to the above- 
stated assessment. The countermeasure signals may in- 
clude a slow vehicle traveling velocity countermeasure 
signal, a parking-aid countermeasure signal, a reversing- 
aid countermeasure signal, a pre-collision countermea- 
sure signal, an adaptive cruise control countermeasure 
signal, a lane departure countermeasure signal, a lane- 
keeping countermeasure signal, or other countermeasure 
signal known in the art. In generating the warning signals 
and countermeasure signals the controller 16 may indi- 
cate to a vehicle operator object information of existing 
objects in various detection areas or sensing zones 
around the vehicle 12, so that the operator may respond 
accordingly. The warning signals may be audible, visual, 
or haptic. When generating the warning signals, the con- 
troller 16 may mute other vehicle audio systems, to pro- 



vide clear alert potential collision and countermeasure in- 
formation. 

[0063] | n s tep 220, the controller 16 may perform one or more of 
the countermeasures in response to the countermeasure 
signals generated in step 218. For example, the controller 
16 may activate a braking system (not shown), to slow the 
vehicle 12 to mitigate the potential for injury to a vehicle 
occupant or to stop the vehicle 12 and prevent colliding 
with a detected object. Upon completion of steps 218 or 
220 the controller 16 returns to step 200. 

[0064] Referring now to Figure 6, a logic flow diagram illustrating 
another method of performing object detection decision- 
making within the vehicle 12 utilizing the system 10 in 
accordance with embodiments of the present invention is 
shown. Although the following steps are described in re- 
spect to the embodiment of Figure 1, the steps may also 
be utilized and modified for other embodiments of the 
present invention. 

[0065] | n s tep 300, as in step 200, the controller 16 operates the 
side vision system 26 in the pre-collision sensing mode. 
In step 302, the controller 16 operates the forward part of 
the vision system 22 in the parking-aid mode, in the pre- 
collision sensing mode, and adaptive cruise control mode 



simultaneously. The controller 16 may also operate the 
forward part of the vision system 22 in the lane departure 
mode and in the lane-keeping mode. Object detection 
signals for each mode of operation are continuously as- 
sessed. The vision sensor 54 located near the front of the 
bumper may be used for frontal parking-aid mode, and 
the vision sensor 56 located near the rearview mirror may 
be used simultaneously for pre-collision sensing, adaptive 
cruise control, lane-departure and lane-keeping modes. 
The controller 16 may proceed to step 312. 

[0066] | n s tep 304, as in step 201, the gear sensor 28 generates 
a gear signal representing a current operating gear. In 
step 306, as in step 202, the controller 16 determines 
whether the vehicle 12 is in a reverse gear in response to 
the gear signal. In step 308, when the reverse gear is en- 
gaged, the controller 16 operates the rearward vision sys- 
tem 24 or the rear part of the vision system 22 in the re- 
versing-aid mode. In step 310, when the reverse gear is 
not engaged, the controller 16 operates the rear vision 
system 24 or the rearward part of the vision system 22 in 
the pre-collision mode. 

[0067] | n step 3i2 j as with step 216, the controller 16 assesses 
whether to generate warning signals, countermeasure sig- 



nals or both in response to detection of objects. In step 
314, as in step 218, the controller 16 may generate warn- 
ing signals or countermeasure signals in response to the 
assessment in step 312. In step 316, as in step 220, the 
controller 16 may perform one or more of the counter- 
measures in response to the countermeasure signals gen- 
erated in step 314. 

[0068] The above-described steps of Figures 5 and 6 are meant 
to be illustrative examples; the steps may be performed 
sequentially, synchronously, simultaneously, or in a dif- 
ferent order depending upon the application. 

[0069] Although the controller 16 is described above as operat- 
ing the sensing system aid modules 18 in response to ve- 
hicle speed and whether the vehicle 12 is in a reverse 
gear, the controller 16 may operate the sensing system 
aid modules 18 in response to other vehicle parameters 
known in the art. 

[0070] The present invention provides a vision-based object de- 
tection system that has a single controller that is capable 
of operating in multiple sensing system modes. The 
present invention simplifies costs of using multiple vi- 
sion-based systems through use of a single controller 
having multiple sensing system aid modules. 



[0071] while the invention has been described in connection with 
one or more embodiments, it is to be understood that the 
specific mechanisms and techniques which have been de- 
scribed are merely illustrative of the principles of the in- 
vention, numerous modifications may be made to the 
methods and apparatus described without departing from 
the spirit and scope of the invention as defined by the ap- 
pended claims. 



